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SELl 
TITLE 

ELECTRONIC BOOK PLAYER WITH AUDIO SYNCHRONIZATION 

CROSS REFERENCES TO RELATED APPLICATIONS. 
Not Applicable. 

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT. 

Not Applicable. 
BACKGROUND OF THE INVENTION. 
L FIELD OF THE INVENTION. 

This invention relates to portable paperless books. 
2. DESCRIPTION OF RELATED ART INCLUDING INFORMATION DISCLOSED UNDER 
37 CFRL97 AND 1.98. 

Printed paper is the traditional medium for books. Other than minor changes in paper, 
binding, and ink technologies, the form of books has not changed significantly in centuries. This is 
changing as electronics and computers are altering the nature, authoring, publishing, cost, and form 
of books. 

Electronics are being incorporated into all aspects of society and especially in the field of 
communications. With the introduction of the computer and the internet into everyday life, the 
written word, including the book, is one of the primary technologies impacted by this revolution. 
Book technology is changing in several directions. 
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The printed word in books, magazines, and newspapers has expanded from paper editions to 
audio versions and electronic versions. Audio books provide an aural rendition of the words in the 
book and use a cassette tape or digital electronic disk as a medium for the information and require 
an electronic apparatus for the expression of the information. 

Audio books have found limited popularity among reading-disabled persons and travelers. 
An audio book may include enhancements such as celebrities reading the book, appropriate multiple 
voices for the various characters in the story, and other audible enhancements such as music and 
sound eflfects which add to the enjoyment of the book. The overwhelming preference for the visual 
book, however, limits the popularity of the audio book. 

The electronic book has taken two forms. The first form is the paper book with electronic 
sensors built into the pages which activate a audio component. The technology enhances the reading 
experience. A book of this form, however, is expensive to manufacture, in part because the electronic 
components are dedicated to a single title. 

The second form of electronic book does not use paper, but instead uses an electronic display 
to present electronic text. Such books appear in a variety of configurations. 

U.S. Pat. No. 4,159,417 discloses a portable, electronic viewer which reads stored 
miniaturized information and displays the information on a thin electronic screen. Although a variety 
of digital storage media is disclosed, the preferred embodiment used a hologram. The viewer was 
constructed with two facing electronic screen "sheets" and resembled a book in that sense. 

U.S. Pat. No. 5,167,508 discloses an electronic book with multiple leaves each of which are 
multilayered with a sheet with printed material mounted against a sheet with diodes. 



The diodes are sequentially lighted, thereby sequentially illuminating portions of the book, and an 
audible discussion of the printed materials provided by a voice synthesizer in sequence with the 
illumination, 

U.S. Pat. No. 5,239,665 discloses an electronic book which retrieves information from 
memory media such as floppy disks or laser cards. In addition, the information may be received by 
telephonic or wireless means. This book allows the reader to adjust the reading speed to that used 
in reading books, magazines or newspapers, 

U.S. Pat. No. 5,339,091 discloses a visual only electronic book with a single visual display 
unit which displays information from floppy disks. The book is powered by a battery or solar cell. 

U.S. Pat. No. 5,417,575 discloses an electronic book with multiple pages formed from a single 
folded sheet of circuitry. Printed images laminated on the pages are illuminated sequentially and 
synchronized audible signals provide enhancing information, for example, informing the reader of 
alternative progressing choices, such as touching or pressing a portion of an image on the page in 
order to enter a game. 

U.S. Pat. No. 5,631,883 discloses a ordinary book of printed texts in conjunction with an 
audio device with a ROM which audibly reads portions of the book corresponding to the opened 
pages. Information on which pages are open is provided by reflective tabs on the margin of each 
page. 

U.S. Pat. No. 5,761,485 discloses a personal electronic book with facing pages each v^th 
several icons which, when touched, calls up the appropriate cover page for a printed product or for 
a video or audio clip. The book is linked via a cellular telephone to a network which provides 
content. 



U.S. Pat, No. 5,802,516 discloses a touchscreen method of controlling the screen display of 
an electronic book using an electronic pen or stylus for navigating the table of contents. 

None of these prior art devices achieve the goals of the present invention, that is, of providing 
a portable paperless book in which the visual and audible displays proceed in synchrony and the user 
5 can experience the audible or the visible or both at the same time. 

BRIEF SUMMARY OF THE INVENTION. 

The portable paperless book of this invention includes a digital storage device for visual and 
audible information and a display system for displaying visual and audible information from the 
storage device wherein the visual and audible information is displayed with the visual and audible 
lOt information in synchrony. 

Book technology is poised to evolve to a new level with the advent of computer, compact 
electronic data storage technologies, and miniature display technologies. Books on tape are a major 
'■■'^ innovation which enables hands- and eyes-free reading of a book. Electronic books are a visual and 

; i multimedia means of displaying book material either in a physical paper book or through a paperless 

""4 

l|g book which displays type using an electronic display. Both books on tape and electronic book 
O: technologies have their own strengths and weaknesses. This invention fiises the advantages of these 
two book technologies to create an innovation which overcomes the weaknesses of each. This is the 
first major innovation in general book technology since Gutenberg. 

Prior art electronic versions of books attempt to mimic paper books. Electronic books either 
20 incorporate electronic features into page-based books for enhanced reading, or have electronic 

viewers which manipulate text and multimedia data for display electronically. 
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Until now, electronic books have had marginal benefits for the reader over traditional book 
technology such as standard print on paper books and books on tape. The paperless book of the 
present invention focuses on Sanction rather than on form in order to use the pov^er of the digital age 
to create a more useful book product. 

People read books under a variety of different conditions, such as reading at work, while in 
bed, and while commuting or otherwise traveling. Visually impaired people often prefer to read 
books on tape or books with large-size type over reading books written in Braille. Books in Braille 
are often expensive and limited in selection, and it is difficult to learn to read books in Braille. An 
uninterrupted period of time for book reading is a rare luxury for many people today. People tend 
to read at opportunities during their busy days. For example, a person may have a book on tape to 
which he or she listens while driving to a commuter train. While on the train, this busy commuter 
may read a book. People are forced to use one type of book media even through their reading 
conditions vary during any given day. Until the advent of the present invention, there was no product 
that adapts the media to a person's changing conditions and preferences. 

The present invention will enable persons such as commuters to read books under constantly 
changing conditions. In addition, this invention is especially usefiil in enabling visually-impaired 
persons access to books. 

This paperless book comprises a high-density portable memory device player which uses 
encoded data (on a ROM) which contmns the complete written text and spoken audio text of a book 
so the book can be read or comprehended under all conditions. The term "ROM" means removable 
high-density memory media such as floppy disks, CD-ROM disks, DVD disks and any other similar 
media to be developed in the future. 



A given book may be encompassed by a single ROM or may require multiple ROMs. For a standard 
book comprising several hours of digital or analog audio, a gigabyte of storage may be required. 
This amount of storage capacity depends on the sound quality and other factors, such as the presence 
or absence of visual illustrations. This invention is completely portable and in this sense is comparable 
to a paperback book or portable CD player. 

This paperless book is closely indexed between visual text and audible text, so that the user 
can choose to experience the visual or audio versions, or both at the same time. There is automatic 
updating or scrolling so that the visual text automatically advances as the audio text is finished. The 
user had complete control of the progression of the reading and can at any point halt the reading or 
go back or forward to any point in the book. 

The visual display may be modified in terms of font and font size and lighting brightness. This 
is especially usefiil for persons with limited visual capabilities. 

The displays are multiple; the visual displays include a display on the top of the book and a 
head-mounted display. The audible display includes speakers on the paperless book, and headphones 
for the use of the reader. 

An objective of this invention is to provide a paperless book in which the text can be read as 
a conventional book. 

Another objective of this invention is to provide a paperless book in which the text can be 
read as an audio book. 

Another objective of this invention is to provide a paperless book with immediate and 
seamless switching between visual and audible reading. 



Another objective of this invention is to provide a paperless book in which the visual and 
audio versions are displayed simultaneously. 

Another objective of this invention is to pro\dde a paperless book in which navigation through 
the entire book is simple and rapid. 

Another objective of this invention is to assist vision-restricted persons in reading books by 
providing a spoken version and by providing enlarged fonts. 

Another objective of this invention is to provide a paperless book which can be used to 
display any multimedia product. 

Another objective of this invention is to facilitate the learning of a foreign language by 
presenting simultaneously the written and spoken versions of the foreign language. 

A final objective of this invention is to provide a paperless book which is inexpensive and easy 
to manufacture using established methods and is without adverse effect on the environment. 
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS. 

Fig. 1 is a perspective view of the top of the paperless book. 

Fig. 2 is a perspective view of the bottom of the paperless book. 

Fig. 3 is a schematic diagram of the components of the paperless book. 

Fig. 4A is a view of the head-wearable visual display. 

Fig. 4B is a view of the headphones. 
DETAILED DESCRIPTION OF THE INVENTION. 

In this application, the term "paperless book" or "electronic book" means books, magazines, 
newspapers, brochures, or other compilations of printed words and images which are visually 
displayed using an electronic device. 



The term *'audio book" means books, magazines, newspapers, brochures, or other compilations of 
printed words and images which are audibly displayed using an electronic device which provides the 
sounds of words, verbal descriptions of images, or music. The term "display" refers to the production 
of visual images or of sounds. The term "connector" means a wire, bus, SCSI, printed circuit or 
other device for making electrical connection between two components. The term "ROM" means 
removable high-density memory media such as floppy disks, CD-ROM disks, DVD disks and any 
other similar media to be developed in the future. 

Fig. 1 shows the top 21, front 22, and left 23 panels of the housing 1 of the paperless book 
100. An electronic visual display 2 is mounted on the top 21 of the housing and the display has the 
approximate size of a small to medium sized book. The visual display is a fiiU-sized 600 X 800 video 
display, A battery compartment cover 3 is adjacent to the electronic display 2. A carrying strap 4 
is used to carry the paperless book. 

Fig. 2 shows the bottom 32, front 22, and left 23 panels of the paperless book. A hinged 
cover 5 allows access to the interior of the book and is used to insert the removable digital storage 
devices or ROM. The headphone and remote video display devices are connected to the book 
through the audio jack 6 and remote video jack 7. Various control switches are located on the front 
22 and left 23 panels of the housing 1. The power selector switch 8 controls the mode of use for the 
book, and is used to select display modes consisting of visual text display with automatic page 
turning, visual text display with manual page turning, audio display, hybrid audio and text display, and 
music CD display. These various modes of operation are termed "oflP', "text", "hybrid" and "audio" 
modes, respectively. The play button 9 turns the book on and off and, when on, serves as a manual 
page turning button. 
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The stop/pause button 10 disengages and stops play when the book is in the hybrid or music mode. 
When the book is in the music mode, this button pauses the music when pressed, and if pressed a 
second time, causes the music to restart at the beginning of the CD. In the hybrid mode, pressing 
the stop/pause button 10 causes the displays to stop. When the button 10 is pressed a second time, 
the visual and audible displays resume operation at the point when stopped. This feature is referred 
to as a "bookmark". 

The buttons 9, 10, and 12-15 serve to enable one to change position within the book 
depending upon what mode one has selected using power selector switch 8. Table 1 shows the 
actions of the buttons in the various modes. 



TABLE 1 



Button 



Mode 



Number 



Text 



Hybrid 



Audio 



9 



Advance page 



Advance audio or text 



Start audio 



10 



Reverse audio or 
text to start of 
previous chapter 



Reverse audio or 
text to start of 
previous chapter 



Reverse audio or 
text to start of 
previous chapter 



12 Bookmark 



Bookmark 



Bookmark 



13 



Reverse page to 
previous page 



Reverse audio or text 
by 10-second interval 
per second 



Reverse audio 

by 10-second interval 

per second 



14 



Not applicable 



Advance audio or text 
by 10-second interval 
per second 



Advance audio 

by 10-second interval 

per second 



15 



Advance page to Advance audio or text 
next chapter to next chapter 



Advance audio 
to next chapter 



When button 12 is pressed in the hybrid or audio mode, the progress of play is halted. If the 
advance button 14 is then depressed, play continues at the point left off. In any mode, when button 
12 is depressed, a menu for storage and retrieval of bookmarked pages appears in text and hybrid 
modes. A "bookmark" is an electronic analog of the placeholder in a book. In the text or hybrid 
mode, the menu visible on screen is selectable to enable the user to add, retrieve, or delete one or 
more bookmarks. In the audio mode, an aural signal will enable the user to add, retrieve, or delete 
bookmarks. The last page read is automatically stored as a bookmark and if the device is turned off 
and back on, the device will seek this bookmark. If no bookmark is found, the device will reset at 
the beginning of the book. Buttons 12-15 serve to move the text forward and backward at varying 
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paces in the text, hybrid, and music modes. The fast forward button advances the book one page 
when pressed, and advances the book to the next chapter when pressed two times in rapid succession. 

Table 1 describes button function for the three modes, Text, Hybrid, and Audio. In the three 
modes button function is roughly analogous. Depressing buttons 10 or 15 causes the user to reverse 
or advance to the next major index point of the book respectively (e.g., a chapter transition). Buttons 
13 and 14 reverse or advance the progress of play by small time increments of 10 seconds for every 
second the button is depressed. These buttons enable rapid navigation through the electronic book. 

The volume level control dial 16 and brightness level control dial 17 control the levels of 
output to the paperless book visual display or loudspeakers and to the head-wearable visual display 
and headphones. The mouse-like scroll button 18 brings up a visual display menu that enables the 
performance of adjustments to the displays and to access specialized data on the display device. It 
allows access to options controlling font size, contrast in the display, word find, dictionary, and 
embedded images and video. The select button 19 selects the particular option highlighted using the 
scroll button. A reverse button sends the display back one page when depressed. When depressed 
twice in rapid succession the reverse button sends the test back to the previous chapter. 

Batteries located in the battery compartment under the battery compartment cover 3 in Fig. 
1 power the paperless book. An alternative source of power is provided by an AC to DC converter 
which is powered by line current and is connected to the paperiess book by a wire and a DC jack 20 
in Fig. 2. 

Fig. 3 is a schematic of the internal components of the paperless book located inside the 
housing 1 in Fig. 1 . The batteries 26 power the paperless book. An alternative power source, DC 
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current from an AC to DC converter, is delivered to the paperless book via a power port 20 which 
is connected to the batteries 26 by connector 40, 

The batteries 26 are connected by connector 58 to a central processing unit (CPU) 24. A preferred 
CPU is a 266 MHz Mobile Pentium II Processor obtained from Intel Corporation of Dupont, 
Washington, The batteries 26 are also connected by connector 42 to the removable storage medium 

27, A preferred removable storage medium device is a Mini DVD obtained from Archos SA of 
dTgny, France. 

The removable storage medium device 27 is accessed by a memory reader, such as a laser 

28, which is connected by connector 44 to the removable storage medium device 27, The laser 28 
is connected by connector 46 to the CPU 24. The interface controls 25 include the controls depicted 
in Figs. 1 and 2, and are connected by connector 48 to the CPU. A permanent memory 29 contains 
data permanently associated with the paperless book, as opposed to memory associated with the 
removable storage medium device 27. A preferred permanent memory is a Serial EEPROM X24C08 
obtained from Xicor, Inc. of Milpitas, California. 

Alternatively, input jack 60 is used to download visual and audio information from a computer 
or a global computer network. Connector 62 connects input jack 60 with CPU 24. 

A temporary memory 30 is connected to the CPU by connector 52. The temporary memory 
is used to store specific data from one or more books previously read so that, for example, the last 
few pages read may be retrieved. 

Audio and visual outputs from the CPU 24 are sent to the paperless book audio display 
loudspeakers and audio display screen, not shown in Fig. 4. Loudspeakers are permanently or 
detachably attached to the housing. Output to the headphones is via audio jack 6 connected to CPU 
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24 by connector 56. A preferred headphone is a KTX4 obtained from KUSS Corp. of Milwaukee, 
Wisconsin. 

Output to the head-wearable visual display is via visual jack 7 connected to CPU 24 by connector 54. 
A preferred head-wearable visual display is a Eglass obtained from Virtual Vision of Redmond, 
Washington. 

The audio output jack 6 is also used to connect the paperless book to an automobile stereo 
system or to a cassette tape player adapter for audio recording. A preferred adapter is a Maxwell 
model CD-330CD, obtainable from Maxwell Corporation of America, San Jose, California. 

Fig. 4A is a schematic depiction of a head-wearable visual display 70. Any suitable visual 
display 72 which provides an image visible in the daylight or nighttime may be used. In particular, 
the visual display may be a ferroelectric display, electroluminescent display, liquid crystal display, or 
light emitting diode display. The head-wearable visual display 70 is retained in place by earpieces 74. 
A connector 76 and plug 78 is used to connect the visual display 70 with the paperless book 100 in 
Fig. 1 at the video jack 7 in Fig. 2. 

Fig. 4B is a schematic depiction of headphones 80. Any suitable headphones 80 comprising 
one or more earpieces 82 and a headpiece 84 may be used. A connector 86 and a plug 88 connect 
the headphones 80 with the paperless book 100 in Fig. 1 at the audible jack 6 in Fig. 2. 

In operation, the paperless book can be read as simply as a book. The visual display of text 
can be perceived either on the paperless book or on the head-wearable visual display, and the image 
may be instantaneously switched from one display to another. The text may be scrolled manually as 
the text is read, or, alternatively, the book may be set to automatically scroll the text to the next page 
after a certain reading time has past. The duration of the reading time may be adjusted by the reader. 
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The audible display uses a voice recording or synthetic speech to display the text audibly 
simultaneously with the visual display. 

Again, the audible display may be instantaneously switched from the paperless book to the 
headphones. No matter what mode in which the visual text is read, the audible display keeps pace. 
In this way the paperless book may be read under the variety of circumstances of modern life. 

Additional enhancements to both the visual and audible displays are available. For example, 
a footnote or an image may accompany a portion of the text. The enhancement is portrayed on the 
visual text in response to a visual indicator of enhancements, such as a line of highlighted text. 
There are similar audible enhancements, such as music, at appropriate positions in the audible text. 

While this invention is termed a paperless book, it in fact is able to access any sort of digital 
information, such as recorded music on a CD, or a movie on a DVD, or M3 recordings obtained from 
networks. Indeed, the information from a ROM may be uploaded to a personal computer using this 
paperless book. 

It will be apparent to those skilled in the art that the examples given here are illustrative only, 
and that this invention is limited only by the appended claims. 
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CLAIMS 
I claim: 

1 . A portable paperless book comprising: 

a digital storage device for visual and audible information, and 

a display system for displaying visual and audible information from a storage device wherein 
visual, audible, or visual and audible information is displayed with the visual and audible information 
in synchrony. 

2. A paperless book of claim 1 wherein the display of visual information is a ferroelectric 
display, electroluminescent display, liquid crystal display, or light emitting diode. 

3. A paperless book of claim 2 wherein the display of visual information is in a head- 
mounted display, 

4. A paperless book of claim 2 wherein the display of visual information is in a screen 
on the paperless book. 

5. A paperless book of claim 1 wherein the audio information display is produced by 
headphones, ear phones, speakers permanently attached to the paperless book, or speakers detachably 
attached to the paperless book. 

6. A paperless book of claim 1 wherein visual display of information is in synchrony with 
an audible spoken representation of the information. 

1. A paperless book of claim 6 wherein the audible spoken representation of the 
information is generated by artificial speech. 

8. A paperless book of claim 1 further comprising a switch which activates and 
deactivates the visual and aural displays. 
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9. A paperless book of claim 1 further comprising an electronic bookmark. 

10. A paperless book of claim 1 wherein the visual and audible information is a movie. 

11. A paperless book of claim 1 wherein the visual and audible information is a printed 
book which appears on the visual display and the printed words are simultaneously read in the aural 
display. 

12. A paperless book of claim 1 wherein the digital storage device is a ROM selected from 
the group of ROM consisting of floppy disk, CD-ROM disk, and DVD disk. 

13. A paperless book of claim 1 1 wherein a highlighted portion of the text indicates an 

associated visual or aural file. 

14. A paperless book of claim 1 further comprising controls which control the speed at 

which the visual and aural information is scrolled. 

15. A paperless book of claim 1 further comprising a control which determines at which 
point in the sequence of visual and aural information the process of displaying the visual and audible 
information will begin. 

16. A paperless book comprising: 
a housing, 

a central processing unit, battery, ROM reader, permanent memory unit, and 
temporary memory unit mounted within the housing, 

a visual display , power jack, head-mounted visual display housing jack, aural display 
housing jack , scroll button, select button, play button, stop or pause button, directional control 
buttons, volume control dial, brightness control dial, door for inserting ROM, and shoulder strap, 
mounted on the housing, 
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earphones, connecting wires, and a earphone jack, 

the earphone jack connected to the aural display housing jack, 

a head-mounted visual display, connecting wire, and visual display jack, 

the visual display jack connected to the head-mounted visual display housing jack, 

17. The paperless book of claim 16 further comprising a alternating current to direct 
current convertor which plugs into the power jack and provides direct power to the paperless book. 

18. The paperless book of claim 16 further comprising a digital storage device for visual 
and aural information, the digital storage device inserted in the ROM loading door in operation, 

19. The process of simultaneously displaying both visual and aural information in a 
paperless book comprising the steps: 

a. downloading visual and aural information from a removable memory storage device, 
a computer, or a global computer network into a temporary storage site, 

b. displaying a page of visual material from the temporary storage site on a visual display, 

and 

c. displaying aural material from the temporary storage site on a audible display, the 
display of aural material in synchrony with the display of visual material 

20. The process of claim 19 wherein the visual and aural information is downloaded from 
a removable memory storage device. 

21. The process of claim 19 further comprising the step: 

d. advancing the visual display to the next page when the audible display corresponding 
to the displayed page is completed. 



17 



ABSTRACT OF THE DISCLOSURE. 

This paperless book is portable and uses removable ROM devices to provide the visual and 
aural information displayed in the paperless book. The book can be read in a visual mode, as print, 
or in an aural mode, as the spoken v^ord corresponding to the print, or in both visual and aural modes. 
The display mode may be conveniently shifted back and forth between visual and aural, for use, for 
example, by a commuter who uses the book in the aural mode while driving and switches to the visual 
mode while riding on a train. In addition, the visual display may be manipulated affecting the 
appearance, for use, for example, by persons with reduced visual acuity. Movies also may be 
viewed using the paperiess book. Finally, portions of the text may be enhanced by additional visual 
images, music or other sounds. 
DRAWINGS 

Figs. 1-4B are attached. 
SEQUENCE LISTING 

Not Applicable. 
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